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UNCERTAINTIES  IN  OPERATIONS  RESEARCH 
Charles  Hitch 

What  I  want  to  do  this  evening  is  to  talk  in  a  general,  but  I  hope 
constructive,  way  about  some  of  operations  research's  most  intractable 
problems  --  those  associated  with  uncertainties,  and  especially  vith  those 
uncertainties  tinged  vith  "game"  elements,  hy  ovn  operations  research 
experience  is  pretty  much  restricted  to  the  domain  of  military  problems, 
but  for  an  examination  of  the  Implications  of  uncertainty,  this  doesn't 
seem  to  me  to  be  too  Important .  For  the  kinds  of  uncertainties  that  ve 
encounter  in  military  problems  have  their  counterparts  and  analogues  in 
business  and  in  everyday  life. 

In  fact,  no  characteristic  of  decision  making  is  as  pervasive  as  un¬ 
certainty.  When,  as  operations  researchers,  to  simplify  a  first  cut  at  an 
analysis,  ve  assume  that  the  situation  can  be  described  by  certainty  equiva¬ 
lents,  ve  may  be  doing  violence  to  the  facts  and  Indeed  the  violence  may  be 
so  grievous  as  to  falsify  the  problem  and  give  us  a  nonsense  solution.  Hov, 
for  example,  can  ve  help  the  military  make  development  decisions  --  decisions 
about  vhlch  aircraft  or  missiles  to  develop  --  vhen  the  essence  of  the  prob¬ 
lem  Is  that  no  one  can  predict  vith  accuracy  hov  long  it  vlll  take  to  develop 
any  of  the  competing  equipments,  or  to  get  them  operational,  hov  much  they 
vlll  cost,  vhat  their  performance  vlll  be,  or  vhat  the  vorld  vlll  be  like 
at  vhat ever  uncertain  future  date  turns  out  to  be  relevant  (if  Indeed,  the 
vorld  still  exists  then)?  When  I  say  "cannot  predict  vith  accuracy"  I  am 
not  exaggerating.  We  find  that  typically,  for  example,  the  production  costs 
of  nev  equipment  are  underestimated  in  the  early  stages  of  development  by 


factors  of  two  to  twenty  (not  2  to  20  par  cent,  but  factors  of  two  to 
twenty. )  Why  they  are  always  underest  lasted,  never  over**  situated,  I  leave 
to  your  fertile  imaginations. 

A  business  Is  confronted  with  uncertainties  of  slmlLur  type  and  order 
when  It  contemplates  diversification.  So  Is  a  household  when  It  tries  to 
decide  whether  to  throw  away  empty  boxes  that  aay  conceivably  be  useful  at 
soaie  future  tine,  or  let  thea  continue  to  clutter  up  the  garage.  So  Is  the 
saae  household  when  It  tries  to  decide  vhat  in  the  way  of  clothes  to  bring 
to  Rev  York  for  an  occasion  like  this.  Who  knows  vhat  the  evening  tempera¬ 
ture  will  turn  out  to  be?  Who  knows  vhat  other  people  will  be  wearing: 

The  really  rcnarkable  thing  Is  that  while  we  operations  researchers 
have  no  good  general  rules  for  how  people  ought  to  decide  when  confronted 
with  such  uncertainties,  aen  nevertheless  do  make  decisions.  Here  I  use  the 
word  "aen"  advisedly,  for  uoaen  appear  to  have  stuck  greater  difficulty. 

There  Is  a  real  difference  between  the  sexes.  Women  apparently  appreciate 
the  absence  of  good  theory,  of  accepted  principles  of  rationality,  and  are 
In  consequence  paralyzed  Into  lndeclslvenese  like  a  too  sophisticated  and 
too  conscientious  operations  researcher.  Men,  on  the  other  hand,  don't 
appear  to  be  bothered.  They  decide  impulsively,  like  the  uncritical  opera¬ 
tions  researcher  who  mistakes  guesses  about  the  future  for  facts,  or  the 
operations  research  charlatan  who  conceals  the  uncertainties  from  his 
customer  for  fe&r  his  recommendations  won't  be  accepted. 

High  speed  electronic  computers  and  data  processing  equipmsnt  aren't 
of  too  stuck  assistance  in  coming  to  grips  with  the  problem  of  how  one  ought 
to  decide.  My  distinguished  predecessor,  Bernard  Koopman,  has  already 
dealt  adequately  with  vhat  he  calls  the  fallacy  of  "mechanitis. "  Of  course, 
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computers  do  help  In  a  mechanical  way.  If  there  are  a  dozen  Interesting 
future  contingencies,  high  speed  computers  will  facilitate  the  computation 
of  outcomes  In  all  twelve.  They  facilitate  .Monte  Carlo  calculations  vhieh 
display  a  range  of  possible  outcomes.  But  they  still  leave  you  with  the 
fundamental  problem:  some  courses  of  action  will  seem  to  be  better  In  some 
contingencies,  others  In  other  contingencies.  Which  Is  optimal  when  you 
can't  know  which  contingency  will  occur? 

Worse,  in  almost  all  our  interesting  problems,  there  are  processes 
whose  results  ve  cannot  even  predict  as  probability  distributions.  There 
Is  no  sharp  line  of  demarcation  between  Insurable  risks,  like  rain  and 
natural  death,  where  there  Is  an  analyzed  mass  of  data  on  similar  occurrences 
to  provide  an  objective  basis  for  calculating  a  probability  distribution;  and 
genuine  uncertainties,  where  such  data  are  simply  lacking.  Lloyds  of  London 
doesn't  draw  the  line  at  the  same  point  as  the  typical  American  Insurance 
company,  and  the  poor  operations  researcher  must  frequently  make  a  stab  at 
situations  that  Lloyds  of  London  would  shun.  Bov  long  will  it  take  us  to 
develop  equipment  capable  of  getting  a  man  to  the  moon  and  back  --  say,  as 
a  function  of  the  rete  of  effort  o~i  the  development.  Most  of  us  have  some 
feel  for  how  ve  would  go  about  making  such  an  estimate,  but  no  two  of  us 
would  get  the  same  answer  except  by  grotesque  coincidence,  and  only  the  most 
foolhardy  and  foolish  would  have  any  confidence  In  his  answer.  Of  course, 
bright  people  have  been  confident  about  similar  predictions  In  the  past  (or 
have  pretended  to  be  for  tome  ulterior  or  praiseworthy  purpose),  hut  the 
record  shows  no  correlation  between  confidence  and  accuracy.  And  If  predic¬ 
tions  are  uncertain  In  the  domain  of  mechanics,  contemplate  some  less  veil 
understood  fields.  For  example,  let's  think  of  estimating  the  time  required 
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to  develop  a  cure  for  cancer  a*  a  function  of  the  rate  of  effort.  I'd  decide 
pretty  quickly  that  I  could  put  my  own  tine  to  better  use.  The  world  Is 
going  to  have  to  get  along  somehow  without  the  answer  to  that  one.  It  was 
2.  Bright  Wilson  who  said:  "Many  scientists  owe  their  greatness  not  to  their 
skill  In  solving  problems  but  to  their  wisdom  In  choosing  then."  (It  Is 
perhaps  significant  that  the  great  scientists  to  whom  he  was  referring  have 
not  rushed  Into  operat Ions  research . ) 

Even  with  hlndelgnt  It's  sometimes  pretty  hard  to  trace  causal  relations 
with  a  time  dimension.  Two  veterans  of  World  War  I  were  recently  talking 
about  their  experiences  In  France  In  1918.  "Remember,"  one  of  them  said  to 
the  other,  "that  camp  back  of  Verdun  v  ere  they  fed  us  all  that  saltpetre? 
Well,  you  know,  I  think  It's  beginning  to  take  effect." 

And  most  perplexing  of  all,  beyond  Insurable  risk  and  genuine  uncer¬ 
tainty,  there  are  the  problems  of  intelligent  opposition.  Of  malevolent 
opposition.  And  the  similar  and  equally  perplexing  problems,  which  we  also 
classify  as  "game"  elements,  of  cooperation,  of  alliances,  of  substantial, 
but  nevertheless  incomplete  community  of  Interest.  How  can  we  predict  with 
any  confidence  what  an  intelligent  (or  unintelligent)  enemy  or  ally  will  do? 
And  hov  can  ve  make  decisions  when  a  good  decision  depends  on  what  enemies 
and  allies  will  do: 

One  thing  is  certain  --  the  operations  researcher  Ignores  all  these 
uncertainties  at  his  peril.  Suppose  that  ve  are  uncertain  about  10  factors 
In  an  analysis  (factors  like  --  will  ve  be  able  to  use  overseas  bases,  will 
the  enemy  have  interceptors  operating  over  X,000  feet),  and  suppose  that  ve 
think  our  best  guess  In  each  case  has  a  60  per  cent  chance  of  being  right 
(we'd  be  lucky  indeed  to  have  such  good  information.)  If  ve  confined  our 
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analysls  to  the  ten  beet  guesses  we  would  be  ignoring  a  set  of  future  out¬ 
comes  which,  taken  together,  have  a  99-1/2  per  cent  probability  of  occurring. 

After  wrestling  with  problems  of  uncertainty  for  a  number  of  years  I 
have  cone,  h*2d  In  hand  with  a  number  of  my  colleagues,  to  some  unoriginal 
but  I  believe  true  and  Important  conclusions.  We  are  skeptical  of  general 
purpose  solutions  to  the  problems  of  making  good  decisions  for  uncertain 
contingencies,  and  are  convinced  that  a  shift  In  emphasis  Is  called  for  In 
our  approach  to  such  problems.  A  shift  from  searching  for  the  best  way  to 
choose  between  two  contingently  unsatisfactory  answers  to  searching  for  a 
better  answer.  From  a  search  for  a  better  decision  rule  to  a  search  for  a 
better  system.  From  sophistication  in  judgment  to  Ingenuity  In  design. 

Let  me  touch  lightly  on  the  unsatisfactory  character  of  the  general 
approaches  to  decision  making  under  conditions  of  uncertainty.  Ifce  reasons 
for  lack  of  satisfaction  are  fairly  familiar. 

First,  the  maximization  of  expected  or  "average"  outcomes,  values,  or 
"utilities."  'Hie  troubles  here  are  formidable.  The  calculation  of  an 
expected  value  requires  knowledge  of  two  things:  of  the  probability  distri¬ 
bution  of  expected  events,  and  of  the  values  of  the  outcomes  associated  with 
each.  But  the  probability  distribution  is  known  only  for  insurable  risks; 
l.e.,  not  often  In  our  business.  Where  there  Is  true  uncertainty  we  must 
either  try  by  research  to  reduce  the  uncertainty  to  something  approaching 
Insurable  risk  status,  or  fall  back  on  the  thin  reed  of  subjective  prob¬ 
ability. 

Similar  or  worse  difficulties  confront  us  In  establishing  the  values 
or  utilities  of  the  outcomes.  In  playing  against  nature  the  maximization  of 
expected  utility  has  a  very  strong  intuitive  appeal.  But  it  is  a  rare  problem 
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indeed  in  vhich  ve  have  any  generally  acceptable  means  of  measuring  utili¬ 
ties.  So  ve  tend  to  fall  back  on  the  expected  outcomes  themselves  --  in 
physical  rather  than  value  terns.  Instead  of  maximizing  the  expected  utility 
or  military  worth  of  the  targets  our  system  vill  destroy,  ve  maximize  sons 
physical  quantity  like  the  expected  number  of  targets  destroyed.  It  is  so 
much  easier  that  way.  But  no  one  who  has  thought  for  as  much  as  five 
minutes  about  this  procedure  could  defend  it.  Typically  it  leads  to  a  reck¬ 
less  choice  of  strategies,  for  it  Ignores  the  importance,  vhich  Is  frequently 
crucial,  of  diminishing  marginal  utility.  In  general  the  more  ve  have  of 
some  physical  good  --  like  dead  Russian  targets,  or  speeches  at  a  dinner  -- 
the  less  Intensely  ve  desire  one  additional  unit.  Cases  even  exist  where 
the  extra  utility  associated  vith  an  additional  unit  becomes  negative,  -ut 
when  ve  maximize  expected  outcomes  ve  simply  as  race  away  this  fact  of  life. 

We  value  equally  a  system  vhich  ve  expect  to  kill  the  enemy  twice  over  half 
the  time,  and  to  be  completely  impotent  the  other  half,  and  a  system  vhich 
kills  him  dead  for  certain,  but  only  once. 

The  other  trouble  with  simply  maximizing  expected  outcomes  or  utilities 
or  anything  else  is  that  it  leaves  the  game  elements  out  of  the  problem  -- 
at  least  explicitly.  This  may  be  all  right  if  you  are  playing  against 
nature,  but  who  plays  against  nature?  You  may  think  you  are  when  you  play 
roulette  in  Las  Vegas,  and  you  are  probably  right  in  thinking  so,  but  I 
assure  you  that  some  who  have  tried  are  convinced  thmt  a  malevolent  intelli¬ 
gence  has  been  working  against  them.  Nature  may  be  neutral,  but  sometimes 
doesn't  seem  so.  Ponder  for  a  moment  the  experience  of  the  Barbadoes  brick¬ 
layer  vho  wrote  the  following  letter  requesting  sick  leave  of  his  employer- 
"Respected  sir,  when  I  got  to  the  building,  I  found  that  the 
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hurrlcane  had  knocked  some  bricks  off  the  top.  So  I  rigged  up  a 
beam  with  a  pulley  at  the  top  of  the  building  and  hoisted  up  a 
couple  of  barrels  full  of  bricks.  Uhen  I  had  fixed  the  building, 
there  vas  a  lot  of  bricks  left  over. 

"I  hoisted  the  barrel  back  up  again  and  secured  the  line  at 
the  bottom,  and  then  vent  up  and  filled  the  barrel  with  extra 
bricks.  Then  I  vent  to  the  bottom  and  cast  off  the  line. 

"Unfortunately,  the  barrel  of  bricks  vas  heavier  than  I  vas 
and  before  I  knev  vhat  vas  happening  the  barrel  started  down. 

Jerking  me  off  the  ground.  I  decided  to  hang  on  and  h&lfvay  up 
I  met  the  barrel  earning  dovn  and  received  a  severe  blov  on  the 
shoulder. 

"I  then  continued  to  the  top,  banging  my  head  against,  the 
beam  and  getting  my  finger  Jammed  in  the  pulley.  When  the  barrel 
hit  the  ground  it  bursted  its  bottom,  allowing  all  the  bricks  to 
spill  out. 

"I  vas  htavltr  than  the  barrel  and  so  started  dovn  again  at 
high  speed.  Halfvay  dovn,  I  met  the  barrel  coming  up  and  received 
severe  injuries  to  my  shins.  When  I  hit  the  ground  I  landed  on 
the  bricks,  getting  several  painful  cuts  from  the  sharp  edges. 

"At  this  point  1  oust  have  lost  my  presence  of  mind,  because 
I  let  go  to  the  line.  The  barrel  then  came  dovn  giving  me  another 
heavy  blov  on  the  head  and  putting  me  in  the  hospital. 

"I  respectfully  request  sick  leave. " 

Whether  or  not  the  Barbadoes  bricklayer  vas  playing  against  a  malevolent 
enemy,  military  operations  researchers  almost  always  are.  And  so  are 
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lndustrlal  operation*  researcher*.  And  vhtre  either  enemies  or  allies  are 
involved,  the  vhole  notion  of  independently  given  probabilities  make*  much 
less  sense,  and  so  therefore  does  the  calculation  of  expected  utilities  or 
outcomes. 

Game  theory,  of  course,  vas  invented  to  fill  precisely  this  breach, 
and  there  is  no  doubt  that  it  has  helped  to  do  so.  There  is  also  no  doubt 
that  the  breach  is  still  far  from  satisfactorily  filled  --  that  game  theory 
must  be  developed  considerably  in  several  different  directions  before  it 
becomes  a  very  practical  or  useful  tool  for  aiding  decision  makers. 

The  difficulty  is  a  fundamental  one.  Ihe  only  kind  of  game  situation 
for  vhlch  ve  have  operational  solutions  is  the  tvo-person  zero-sum  variety. 
And  very  rarely  in  the  real  vorld  does  the  military  or  industrial  operations 
researcher  encounter  any  situation  approximating  tvo-person  zero-sum.  It 
is  apparent  that  there  Is  nothing  zero- sum  about  war,  expeclally  the  modern 
thermonuclear  kind.  What  Russia  loses  ve  do  not  necessarily  gain;  in  ot, 
ve  and  the  Russians  have  a  strong  ccmnon  interest  in  escheving  certain 
strategies,  like  end- of- the -vorld  machines.  Similarly  in  business  not  only 
are  many  more  than  tvo  "persons"  typically  involved,  but  our  relations  with 
none  of  them  are  those  of  pure  conflict  (i.e.,  "zero-sum").  A  company  vlll 
compete  vlth  ther  companies  in  the  same  Industry,  but  not  in  a  your-loas- 
ls-my-galn  manner;  there  is  broad  mutuality  of  interest  too.  And  its  rela¬ 
tions  vlth  customers,  vlth  suppliers,  and  vlth  labor  are  llkevlse  extremely 
complex  mixtures  of  conflict  and  cooperation. 

It  is  frequently  argued  that  max-mln,  the  solution  for  the  tvo-person 
zero-sum  game,  is  unduly  conservative.  Whether  it  is  conservative  vhen  the 
game  is  really  tvo-person  zero-sum  I'm  not  sure:  perhaps  not.  But  in  almost 
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all  real  games  or  clrcvastances,  which  are  not  tvo-peraon  zero-sum,  a  max- 
mln  aolutlon  iff  either  conservative  because  It  greatly  Halts  your  opportun¬ 
ities  to  capitalize  on  the  enemy's  al stakes  --  or  worse,  It  Biases  some 
rltal  elosent  of  the  problea,  like  an  laportant  mutuality  of  Interest. 

Clearly  In  playing  against  nature  It  can  be  outrageously  conservative  to 
concentrate  exclusively  on  alnlalzlng  the  worst  that  malevolent  nature  can 
do  to  you.  Nature  isn't  that  malevolent. 

In  playing  against  the  Russians  or  any  enemy  In  this  thermonuclear  age, 
max-mln  is  worse  than  conservative;  It  completely  Ignores  the  strategy  which 
almost  all  of  us  intuitively  prefer,  the  strategy  of  deterrence,  the  strategy 
of  preventing  the  war  from  happening  at  all.  We  attach  very  high  positive 
value  to  this  outcome  of  no  thermonuclear  war.  Do  the  Russians  therefore 
attach  a  high  negative  value  to  It,  as  the  zero-svm  assumption  postulates? 

Hot  if  they  are  as  smart  In  choosing  strategies  as  they  seem  to  be  In  develop¬ 
ing  rockets.  Instead  of  max-mln- Ing,  Instead  of  concentrating  exclusively 
on  minimizing  the  worst  the  Russians  can  do  to  us,  It  may  well  pay  to  devote 
some  of  our  energies  to  promoting  an  outcosm  which  both  we  and  the  Russians 
would  value  highly.  Mutual  deterrence  la  preferable  to  mutual  near- annihila¬ 
tion,  even  If  we  have  aade  ours  not  quite  so  near  by  effective  m&x-mln-ing. 

Unfortunately,  such  partial  mutuality  of  Interest  can  seldom  be  accomo- 
dated  by  marginal  adjustments  In  a  max-mln  aolutlon.  It  is  likely  to  alter 
the  whole  character  of  the  problem,  and  the  solution.  For  txample,  one  of 
the  universal  characteristics  of  good  two- person  zero-sum  play  Is  the  com¬ 
plete  absence  of  communication  between  the  players.  Each  chooses  his  stra¬ 
tegy  In  Ignorance  of  hit  opponent's  choice.  In  the  case  of  a  pure  max-mln 
stratzgy  It  does  the  opponent  no  good  to  learn  your  strategy.  In  cases 
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vber*  he  can  profit  by  learning,  J  *ake  It  doubly  Impossible  for  him  to 

learn  by  not  letting  yourself  knov.  You  six  your  strategies,  and  pick  one 
for  each  play  at  the  last  accent  by  spinning  a  wheel  of  chance.  You  estab¬ 
lish  your  coamand  post  in  Las  Vegas. 

Contrast  the  real-life  problems  of  playing  vlth  the  Russians  the  kind 
of  non- zero -sun  game  In  which  there  is  mixed  conflict  and  mutuality  of 
Interest.  Coaeunlcatlon,  explicit  or  Implicit,  becomes  the  essence  of  the 
problem.  If  ve  are  to  prevent  the  Russians  from  aax-aln-lng  (which  might 
veil  involve  their  attacking  ua),  ve  have  to  reveal  to  them  that  our  pay¬ 
off  matrix  la  not  the  obverse  of  theirs,  and  vhat  it  Is.  If  ve  have  a 
clever  and  effective  technique  for  protecting  our  retaliatory  force  from 
surprise  attack,  ve  must  somehow,  without  giving  them  Information  that 
would  seriously  reduce  Its  effectiveness,  make  them  knov  that  It  la  effec¬ 
tive.  You  don't  keep  your  ability  to  retaliate  a  secret.  If  we  sense  that 
the  Russians  mistakenly  fear  a  surprise  attack  by  ua,  and  therefore  may  try 
to  preempt  us,  our  moat  Important  problem  la  somehow  to  convey  to  chea  and 
make  them  believe  that  ve  have  no  such  Intention.  These  problems  of  coanunl- 
catlng  are  perhaps  moat  difficult  and  most  critical  In  finding  strategies  to 
fight  limited  wars  that  will,  among  other  desirable  things,  keep  them 
limited. 

I  am  not  Just  saying  that  someone  must  find  ways  of  solving  n-  per  son 
variable- sum  games.  I  doubt  that  pat  solutions  will  be  found  --  at  least 
in  our  generation.  What  is  needed,  I  think,  Is  more  attention  to  certain 
aspects  of  n-person  and  non- zero- sum  garnet.  And  not  only  by  professional 
mathematicians.  As  Ttom  Schelllag  has  recently  been  stressing,  and  as  von 
Neumann  well  understood,  the  outcome  In  n-person  games  is  likely  to  depend 
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criticaliy  upon  psychological  and  sociological  factors  which  ve  cannot  yet 
describe,  explain,  or  aanlpulate  In  rigorous,  mathematical  language. 

Let  me  pass  quickly  orer  another  technique  for  dealing  with  game  un¬ 
certainties;  namely,  gaming.  Gaming  Is  not  tied  to  two-person  zero-sum 
assumptions,  and  Is  therefore  a  broader  and  more  flexible  device  than  two- 
person  zero-sum  game  theory.  I  am  all  for  gaming  and  other  forms  of  simu¬ 
lation.  I  think  they  are  Invaluable  for  teaching  purposes  --  and  of  course 
they  have  long  been  so  used  by  the  military.  I  think  that  free  play  games 
can  also  be  very  useful  In  providing  "Insights"  to  players  and  observers, 
in  suggesting  Important  factors  that  might  otherwise  be  overlooked,  etc. 

But  as  a  problem-solving  device  gaming  in  any  of  Its  numerous  forms  has 
severe  limitations.  Many  of  these  stem  from  the  fact  that  gaming  Isn't 
analytic.  You  can't  do  much  testing  for  sensitivity.  You  can't  afford  to. 
You  never  know  why  the  games  came  out  as  they  did.  It  may  have  been  because 
you  played  too  few  times  and  got  a  badly  biased  sample  of  results.  Or  be¬ 
cause  sosk  of  the  players  were  too  stupid  for  their  real-life  counterparts 
••  or  too  clever.  Or  because  the  players  were  using  wrong  pay-off  functions. 
Or  because  they  were  cowminl eating  too  much,  or  too  little.  I  have  yet  to 
see  a  case  where  a  hard  problem  was  convincingly  solved  by  a  game.  I  have, 
on  the  other  hand,  seen  a  good  many  cases  of  gaming  that  I  thought  were 
worth  the  cost  ••  which  Is  always  high. 

So  what  does  the  poor  operations  researcher  do?  Eere  he  is,  faced  by 
his  fundamental  difficulty.  The  future  is  uncertain.  Nature  Is  unpredict¬ 
able,  and  enemies  and  allies  are  even  more  so.  Be  has  no  good  general  pur¬ 
pose  technique,  neither  maximizing  expected  somethings,  nor  max-mln-lng, 
nor  "gaming  it,"  to  reveal  the  preferred  strategy.  How  can  he  find  the 
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optimal  course  of  action  to  recoMend  to  his  decision-maker? 

Hie  staple  ansver  Is  that  he  probably  can't.  Hie  same  answer  Is  also 
the  beginning  of  vlsdom  in  this  business.  Hiere  has  been  altogether  too 
ouch  obsession  with  optimising  on  the  part  of  operations  researchers,  and 
I  Include  both  grand  optimising  and  sub- optimizing.  Most  of  our  relations 
are  so  unpredictable  that  ve  do  veil  to  get  the  right  sign  and  order  of 
magnitude  of  first  differentials.  In  acs-  of  our  attempted  optimisations 
ve  are  kidding  our  customers  or  ourselves  or  both.  If  ve  can  shov  our  cus¬ 
tomer  hov  to  make  a  better  decision  than  he  would  otherwise  have  made,  ve 
are  doing  veil,  and  all  that  can  reasonably  be  expected  of  us. 

And  this  much  ve  frequently  can  do.  It  is  much  easier  to  find  a  system 
or  strategy  that  dominates  (or  nearly  dominates)  some  other  system  --  say 
the  one  currently  planned  --  than  it  is  to  find  a  system  that  dominates  all 
other  systems.  Hiere  is  great  scope  here  for  the  use  of  the  a  fortiori 
argument,  for  shoving  that  evtn  in  the  less  favorable  contingencies  your 
system  docs  as  veil  or  better.  And  if  ve  can't  fJ nd  such  a  system  ve  can 
frequently  invent  one.  In  fact,  it  has  besn  our  experience  that  ingenuity 
is  frequently  more  profitably  exercised  in  invention  than  in  mere  Judging. 

If  System  A  is  good  in  some  likely  contingency  1,  and  very  poor  in  another 
likely  contingency  2,  sod  System  B  vice  versa,  the  really  useful  thing  for 
the  operations  researcher  to  do  isn't  to  sake  the  perfect  choice  betveen 
A  and  R,  but  to  invent  or  develop  a  System  C  that  vlll  perform  reasonably 
veil  in  both  contingencies.  If  he  can't  do  anything  else,  he  can  find  a 
means  of  providing  some  insurance  against  the  uncovered  contingency,  and 


calculate  its  cost. 
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Another  thing  that  he  can  frequently  do,  especially  in  problems  in¬ 
volving  research  and  development,  is  to  ascertain  the  critical  uncertainties 
and  re  coemend  strategies  to  reduce  th«  --  to  buy  information.  If  ve  don't 
knov  which  of  tvo  dissimilar  techniques  for  missile  guidance  will  turn  out 
to  be  better,  the  best  recomsendatlon  is  very  likely  to  be:  keep  them  both 
In  development  a  while  longer  and  choose  between  them  when  you  have  more  and 
better  information.  Never  mind  the  people  who  call  you  indecisive.  You  can 
prove  that  this  kind  of  indecisiveness  can  save  both  money  and  time. 

Of  course  you  can't  afford  to  try  everything.  There  isn't  enough 
budget.  There  aren't  enough  resources.  You  remember  when  ve  used  to  say 
"If  you  gave  the  military  services  everything  they  asked  for  they'd  try  to 
fortify  the  moon' M  (Ve'U  have  to  change  that  figure  of  speech.)  Actually, 
that's  why  operations  research  and  operations  researchers  are  important. 
There 'd  be  no  problems  for  us  if  there  were  no  constraints  on  resources.  It 
is  our  Job  sad  opportunity  to  find,  or  Invent,  vlthlc  the  constraints,  soma 
better  pattern  of  adjusting  to  an  uncertain  world  than  our  betters  would 
find  if  ve  weren't  here;  or  some  better  way,  taking  costs  and  payoffs  into 
account,  to  buy  information  to  reduce  the  uncertainty. 


